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ABSTRACT ; 

This report summarizes information presented ina ¥ 


technical report concerning the rcle cf vocabulary kncwledge in 
reading comprehension and is designed to be read by educators not 
directly involved in research themselves. It states that while an 
asSessaent of the number cf meanings a reader knows enabies a 
remarkably accurate prediction cf an dividual's ability to 
comprehend discourse, the reasons why"word knowledge correlates with 
comprehension cannot be determined satisfactorily without improved 
methods of estimating the size of people's vocabularies. It suggests 
that improved assessment methcds depend upon thoughtful answers to 
questions concerning what a word is, what it means to know the 
meaning.of a word, and the most efficient way of estisating 
vocabulary size from an individual's performance on a,samfle of 
words. (MKM) ; 
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Our aim in this paper is to summarize what is known about the role 

of vocabulary knowledge in reading comprehension. Though word identi fi- 
cation skills are important in reading, this paper is concerned exclusively 
with knowledge of word meanings. An assessment of the number of meanings 

a reader~- knows enables a remarkably accurate prediction of this individ- 
ual's ability to comprehend discourse. That this is true may seem self- 
evident; why it is true is poorly understood. Determining why is important 
because what should be done to build vocabulary knowledge depends on why 

it relates so strongly to reading. The deeper reasons why word knowledge 
correlates with comprehension cannot be determined satisfactorily without 
improved methods of estimating the size of people's vocabularies. Improved 
assessment methods hinge, in turn, on thought ful answers to such questions 
as what is a word, what does-it mean to know. the meaning of a word, and. 
al is the most efficient way of estimating vocabulary size from an ‘ | 


individual's performance on a sample of words. 


Vocabulary Knowledge and Linguistic Competence / 


Sake, 


i f ri 
Neadures of vocabulary knowledge are potent predictors of a variety ; 


Fy 


of inditcbs of lingutstic competence. The strong relationship between 


rs 


vocabulary and general Verbal ability is one of the most robust findings 


in the history of intelligence RES UNGy Terman (1918), for instance, 
reported a correlation of .9] between mental age (as assessed by the 


Stanford Revision of the Binet-Simon Scale) and the vocabulasy subscale. 
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On.this basis he suggested that the vocabulary measure alone constitutes 

a good estimate of performance on the entire scale and thus could be used 
as a short measure. Since then, this suggestion has been tested with 
various age groups. Table | summarizes representative evidence. In these 


studies, correlations between vocabulary subtest scores and total test 


scores on a number of different aptitude tests have ranged from .71 to .98. 


An equally consistent finding has been that word knowledge is strongly 
related to reading comprehension. Davis (1944, 1968) factor analyzed nine 
comprehension tests and found a main factor for word knowledge eee a 


vocabulary test loaded about .8. In the years that followed, many 


have shown that a major factor in reading comprehension is nT ee know |] - 


edge (e.g., Botzum, 1951; Michael, Zimmerman, & Guilford, 1951; Wrigley: 
Sauidare, & Newhaus, 1958; Clark, 1972). The fande of factor loadings 
for vocabulary tests in these studies was .41] to .93. These findings 
indicate the need for a central role for word knowledge in any model of 
reading comprehension. 

Analyses of readability (cf. Bormuth, 1966) also demonstrate the 
preeminent role of word knowledge. In a study of the factors that make 
prose difficult to read, Coleman (1971) examined-morphological, syntactic, 
and ‘Semantic properties of words and sentences. While he found sentence 


complexity to be a fairly important variable, he was able to conclude that 


a 


studies | 
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"any measure of sich complexity (number of letters, motphenes, or syllables; 
frequency of usage) will account for: about 80% of the predicted variance’ 
(p. 184). Klare (1974-1975), in a review of readability, ath: eonglouee that 
\ ‘ 
a two-variable formula is sufficient a most practical purposes: Bie 
variable relates to word difficulty and the other to syntactic or sentence 
difficulty. He went on to conclude that the word variable is consistently 
more highly predictive of difficulty than’ is the sentence variable. As 


would be expected, an index of vocabulary difficulty has always been 


4 
given the heaviest weight in readability gee 


ys 


Why is Vocabulary Knowledge a Major Factor in Linguistic Competence? 
There are three more or less distinct seks of why vocabulary know! - 
edge is such an extraordinary correlate of linguistic competence. We will 
call the first the instrumentalist BOS retons Individuals who score wee 


. 


on a vocabulary test are likely to know more of fhe words in most texts 

° 
they encounter than low scoring individuals. mate of che instrument- 
alist hypothesis is that knowing the words enebley text comprehension. In 
other. words, this hypothesis claims that vaeabolaby knowledge is directly 
and importantly in the causal chain resulting in text comprehehsion. Unlike 
the two positions described below, the instrumentalist hypothesis has 
nothing to say about where vocabulary knowledge comes from, but only that, 
once possessed, it helps the reader understand text. 


According to the second position, vocabulary tests measure verbal 


aptitude. A person who scores high on such a test has a quick mind. With 
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the same amount of exposure to the culture, this individual has learned 


\ 


k 


more word meanings. He or she also doiiprehends disgourse more readily 
‘ 

than the person who scores low on a vocabulary test. The essential claim 
of the aptitude hypothesis is that persons with large vocabularies are 
better at discourse comprehension because they possess superior mental 
agility. A large vocabulary is not conceived to be involved in a direct 
way in better text understanding in this model. Rather vocabulary test 
performance is merely another reflection of verbal ability and it is 
verbal ability that mainly determines whether text will be understood. 

The third position is the knowledge hypothesis. Performance on a 
Seda airaty test is seen as a reflection of the extent of exposure to the 
culture. The person who scores high has deeper and broader knowledge 
of the culture. The essential idea is that this knowledge is 
‘crucial for text understanding. Rather than being directly important, 
possessing a certain word meaning is only a sign that the advil Tay 
possess the: kriewledge needed to understand a text. For instance, the 
child who knows the word mast is likely to have knowledge about sailing. 
This knowledge enables that child to understand a text that contains 
sentences which do not even involve the word mast, such as, ‘We jibed 
sucdenly and the boom snapped across the cockpit." 

Of course, jibe, boom, and cockpit are specialized words, too. It 
might be wondered whether, the instrumental hypothesis and the knowledge 


hypothesis are really different. » Stong versions of the two positions 
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are distinguishable, at least. The instrumental position, as we choose 
to characterize it, stresses individual word meanings. The knowledge 


view emphasizes conceptual frameworks or ''schemata;'' individual word - 


meanings are merely the exposed tip of the conceptual iceberg. 


Instructional Implications of Different Hypotheses 
About Vocabulary Knowledge , 


Which of the three positions is most. tenable? The main point to be 
made is that there are neither the theoretical tools nor the data to 
sustity a conclusion at the present time. A second important point is 
that it would be naive, indeed, to begin with the idea that one of the 
positions will turn out to be entirely Hebe and the other two entirely 
wrong. However, it is important to reer pers of the three hypotheses 
about vocabulary knowledge is most nearly correct. because each one has 
radically different cisieeaeuas for reading instruction. At one extreme, 
some who endorse the verbal aptitude hypothesis are fatalistic about whether 
any environmental factor can have a major influence on children's reading. 
They tend % recommend family planning instead of curriculum innovation 
se the final solution to the reading problem. 

Of course the verba | aptitude position does not require the belief 
that heredity is predominant. Alternatively, there are those who maintain 
that verbal ability grows in proportion to the volume of experience with 
language. The greater the opportunities to use language the faster and 


more efficient become the elemental process!Ing operations. In turn, speed 
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and efficiency permit greater benefit from each successive language en- 
counter. More detailed mExeanes of this sort of position can be found in 
the well-known paper by La Berge and Sandee (1974) and a recent paper by 
Perfetti and Lesgold (in press). 


Fi; The latter farmulation of the verbal aptitude hypothesis leads to 


the recommendation that educators should try to maxjmize the amount of 


t reading children do. However, this is not very newsworthy. It is a 
Y practice that would be endorsed no matter what the theoretical persuasion. 
. The distinctive emphasis in the verbal aptitude position is on speed and F 


attietency of processing. This emphasis gives rise to the recommendation 
that beginning readers and poor readers receive extensive drill and 

aruev tes on the ''fundamentals'' of reading. According to Perfetti and 
Lesgold (in press), the drill activities should taehadé even more practice 
than typically provided in word vocalization, more practice in speeded 
word recognition, and more practice in immediate memoty for the literal 
content of text. It should be noted that these suggestions are offered 

in the spirit of a hypothesis. Perfetti and Lesgold acknowledge that, | 
so far at goad attempts to facilitate text comp re ension by providing 

a 
speeded word drills have not proved very success Cul {see especially 


a / 
Fleisher & Jenkins, 1977). / 


While, like everyone else, the advocate Aa instrumental hypothesis 


favors lots of reading and varied Janguage experience, the distinctive 


feature of this view is that it invites direct vocabulary building 
¥ 


d 
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exercises. Betker (1977) has argued strongly for the instrumentalist 


. 


position. He maintains that once decoding skills have been mastered, the 
chief remaining factor in determining whether a child will be a successful 


reader is vocabulary knowledge. He claims that schools have never had 


4 - 


reading programs that systematically build vocabulary. Children from - 
5 ; ¢ gu 83 
middle class ‘backgrounds pick up word meanings anyway. ‘But the Same is 


less true, Becker argues, of children-coming from lower class homes, which 


often fail to provide support,for the continuous vocabulary and concept 


growth important to school work. ‘ Consistent with this assumption is some 
* i 
recent research of Hall and Tirre (1979), who found that lower class parents, 


particularly lower class Black parents, use substantiatiy fewer of the 
words found in standardized intelligence tests when speaking with their 
children than do middle class parents. 

Becker proposes a reading curriculum in which every child would learn 
about .7,000 basic words from direct instruction. The figure 7,000 tithe s 
from one estimate of the number of basic words known ®y the sierage high 
school senior (Dupuy, 1974). Becker acknowledges that there are families 
of err aere related meanings; thereby permitting the child some generali- 
zation beyond the words that are specifically taught. By and large, though, °* 
he believes chee eaautns one vocabulary item gives little advantage in 
learning the next one... For instance, he i lustrates instruction on the 

*” 


following set of unrelated words: help, support, insist, toil, resist, 


recognize, assist. Even the so-called “concept side'' of the instruction 


ss 
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entails a component analysis of isolated words. So if this assumption is 
correct, direct teaching of a vocabulary of even 7,000 basic words would 
be an enormous task. Becker estimates that about 25 basic words would 
have to be taught per week from the third through the twelfth grade (p. 539). 
The distinctive curriculum implication of the knowledge hypothesis is 
that generally new vocabulary ought to be learned in the context of acquir- 
ing new knowledge (cf. Goodman, 1976, p. 487). Every serious student of 
reading recognizes that the significant aspect of vocabulary development 
is in rhe learning of concepts not just words. The additional point that 
the knowledge position brings to the fore is that concepts come in clusters 
that are systematically interrelated. Returning to an earlier example, 
the concept of mast ania be acquired independently of concepts such as 
boat and sail. Thus, it would seem to be sensible for people to learn the 
_ jargon in the context of learning about sailing and the anatomy of sail- 


boats. According to the knowledge hypothesis, if a child were really 
naive, ieyina to a a single sail concept and word in isolation from 
the set of, related concepts and words would be inefficient in the best 

case and completely Frdi iees in the worst case. 

The more general point about the role of knowledge in vocabulary 
learning is intuitively clear. Imagine you wished to teach some French 
vocabulary to, let us say, two groups of English-speaking Canadian children, 
evenly matched on aptitude and achievement. One group is from a downtown 


urban area; the other is from a small fishing village. The body of words 


you wish to teach is concerned with fishing (trawlers, rods, nets, casting, 


10 
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sbait, currents, etc.). Would you expect one group to learn the words more 


quickly oar easily than the other? Why? We do not know of actual research 
that has dealt systematically with these questions. One somewhat relevant: 
study was carried out by Allen and Garton (1968). They found that physics 
students were much better than art students in recognizing physics words. 
They concluded that, for art students, physics words are semantically 
indistinct and thus have to be recognized on a more piece-meal basis. 
Familiarity with san area of knowledge increased the familiarity of the 
relevant words. | : oe 


Knowledge can be sliced in various ways.. Thus far in this section, 


we have considered sets of words related betause they are used in talking 


about the same topic. Viords hay also be conceptualized in terms of 
families related to one another because they convey related sets of dis- 
tinctions. Consider an example involving verbs of visual pereeptien.: 
The basic verb is see. If you notice that look involves a deliberate: (a 
act of seeing, it can then be appreciated that glimpse refers to a short 
act of seeing whereas glance refers to a short act of looking. Stare, 
on the other hand, refers to a prolonged act of looking. (The variations 
in sense among these verbs can be understood interms of just two semantic 
features, intention and duration. Further distinctions would be required 
to encompass other verbs of visual perception such as notice and examine. 
-We would consider that a lesson that helped children sharpen and 


extend the distinctions involved in visual perception words to be consistent 
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with the spirit of the knowledge position. What the knowledge position 


10 


would not countenance is a Separate vocabulary lesson that included / | 


/ 


/ 
glance, mast, and a miscellany of other words. Herein lies a difference , | 


from the instrumentalist position, which does not seem to us to preclude 
/ 


exercises involving lists of unrelated words. # | 


Johnson and Pearson's (1978) book, Teaching Reading Vocabylary, 


appears to represent predominantly the knowledge position, though it is 


an eclectic treatment that also reflects influences from the other two 
views. Johnson and Pearson advocate teaching a basic sight vocabulary 
using "intensive direct instruction in the early gradgs and with older 
children who do not read well'' (p. 28). They also/endorse both direct 
and indirect) means for teaching phonics, sPoReblae AorpRStoutcal analysis, 
causing vocabulary knowledge to expand,- and teaching the use of the 
dictionary and’ thesaurus. Johnson and Pearson devote a chapter to the 

use of contextual] clues to figure out the meanings of unfamiliar and 
ambiguous words. Otherwise most of the exercises and games Suggested . 
throughout ‘the book involve groups of words outside the context of 

stories or text book chapters. However, the words usually involve 

sets of ieiucaa ted distinctions such as were illustrated above with 
verbs of visual perception. Almost every ce aes designed to expand 
children's sensitivity to these distinctions. There is an apparent dis- 
crepancy between the goals of the activities, which are concerned with 


conceptual distinctions and relations, and the format of the activities, 
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which is based largely on isolated words. If the knowledge perspective 
were strictly adhered to, yocabulary instruction would not be thought 
of as a separate subject in school. | 

esas sake of clarity of exposition,, we have presented the aptitude, 
instrumental, and knowledge positions in uncomplicated and somewhat over- a 
drawn form. We must emphasize again that no serioys scholar in peadieny 
or related fields rigidly adheres to any one of these positions. In 
particular Hunt (1978), who is identified with the aptitude hypothesis, 
has explicitly and emphatically stated that vocabulary size also is a 
reflection of an individual's accumulated knowledge of the world. Becker, 


whom we labeled an instrumentalist, heartily endorses some of the impli- 


cations of both the aptitude and the knowledge views. Reading has been 


a fractious field. If a policy were followed of avoiding controversy . 
where none genuinely exists, the quality of intel ]ectual.exchange and the 
sociopolitical climate might improve to the point where someone within 
| the next decade could write a book entitled "Learning to Read: The 5 ae, 
Great Consensus." ; | “Ss 
What Does It Mean to Know the Meaning of a Word? -. « is “she ws 
<¥ 2" Ve-is: net clear that, if Ludwig Wittgenstein and Bertrand Russel] . 
were left alone in a room for three hours, they could decide that they om 


really knew the meaning of dog. As Labov (1973) said, ‘words 


have often been called slippery customers, and many scholars have been 
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distressed by their tendency .to shift their meanings and slide out from 


under any simple definition"! (6.2 34) )'s.¢ : 


Bt .. An ordinary adult engaging in an ordinary conversation will be 


« p vod ; , 


absolutely sure he knows the meaning se ai foee all of the words he hears. 
“ 
Notice that the restriction to ordinary use is an important aspect of 
this confidence. honstder the term gold, for example. The sae who 
is .sure he knows ihe meaning of thts word’ in an ordinary use will quickly. 5 (fd 


‘ 


retreat when in the company of jewelers, mining engineers, geological 


survey assayists, or metalurgists. 


we. What does a person know when he knows the meaning of a word in its ‘ 


ordinary, every-day, garden-variety sense? This issue is addressed in 
what we will refer to as the Standard Thesity of semantics, according to 
whites the meaning of a word can be analyzed into features (also called 
components, attributes, or properties), each of which represents one of 
the distinctions conveyed by the word. Necessary or essential features 


are usually distinguished from features that are merely characteristic. 


For instance, having a back could be said to be a necessary feature of 


4 


chair since an object that is otherwise a chair except.for the lack of 
a back is really a‘stool instead of a chair. On the Bthee Hands, the 
ability to fly is only a characteristic feature of bird since some birds Vv 
(penguins) don't fig ai all and others (chickens) do so very poorly. 

To define a term, in the strong sense, is to list the features 
fccuer wenwes capture the essence of the thing ‘(or event or quality) 


designated by the worth. Saying this another way, a proper definition 


% 
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indicates the attributes a thing must have in Sider to be designated by’ 

a word; if any of these necessary properties were missing that saeaeeata 

not apply. Before we choose this as our criterion-in the testing of 

children's word knowledge, however, we might wish to examine how well it 

applies to adults! normal use and understanding of words. 

How able are people ta defjne the words they are sure they know? 

"Not very'' is the answer if one insists. upon the sivous sense of define. . 
Consider gold again.. Upon ing asked to define gold, the ordinary citizen 
might say that gold (a) is precious, (b) is a metal, and (c) that Tt fae a 
particular yellowish (i.e., golden) hué» The ‘problem is that none of 

these is a sskanyen peauaee, Not all gold Ts. 2 golden color. If, say, 

the Chinese were to discover a mountain of gold, the substance: would no 
longer be precious. Not even the attribute ee ae metal can be ¢on- 
sidered to be an eternal, immutable property of gold for, unteely though 
it is, there might be a scientific Kieeeehouenn in which it was discovered 
that gold is not a metal. If either of these things were to happen ae se. : 
rene be forced to conclude that gold did not exist. As Putnam (1975) meee 
has noted, this fe a very odd xanediaten, because there would still be 
this ''stuff'' lying around that peop le used to call gold. We have a right 

to be suspicious of a semantic theory that backs us into such a peculiar 

corner. | 


There are other serious problems with Standard Theory. Notably, 


_ the members of a class called by the same name frequently do not all 


Ig 
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share a single set of common properties. Wittgenstein (1953; see also 
Rosch, 1973; Rosch & Mervis, 1975) argued that things designated by the 
same word generally are related by "famt ly resemblance.'' He:intended an 


ied 


analogy to a human family whose members look and act alike. Mother and 
‘one son may have ‘a prominent nose. Father a daughter may have the _— 
hair color. And so on. But there may be no single respect jin which they 
are all alike, no single feature which they all share. Wittgenstein 
claimed family resembNance was the most accurate characterization of 

the relationships among the various uses of most common words. To 
illustrate his point, he analyzed uses of the term game, noting the 
similarities and differences between team games, board games, and 
children's games. 

A great deal more could be said about semantic theory. (For author- 
itative, current treatments, see Clark & Clark, 1977, especially chapters 
11-14; Fillmore, 1975; and Miller & Johnson-Laird, 1976.) The main“point 
of this brief excursion into the meaning of meaning ,is to caution against 


holding up a standard of word comprehension for children that adults could 


not meet. a 


Depth of Word Knowledge 


It is useful to distinguish between two aspects of an individual's 
vocabulary knowledge. The first may be called ''breadth'' of knowledge, 
which we mean the number of words for which the person knows at least 
. “Ser Pg = ‘ 


some ofthe significant aspects of meaning. Later sections of this paper 


will be concerned mainly with breadth of knowledge. 
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Treated in this sect on is a second dimension of vocabulary knowl- \ 
edge, namely the quality "depth'' of understanding. We shall assume \ 
that, for most purposes, a\person has a sufficiently deep understanding 
im or her all of the distinctions that would 


—— 
adult under normal circumstances. 


of a word if it conveys to 

Bre understood by an ordina 
Eve Clark (1973) has rshalled an array of evidence which shows 

that the meaning a elma child has for a word is likely to be more global, 
less differentiated’ than thpt of an older person. With increasing age, 
the child makes more and e of the adult distinettons. In other words, 
‘when first acquired, the cqncept a child has for a word need not include 
all of the features of the/adult concept. Eventually, in the normal 
course of affairs, the misBing features will be learned. Most of the 
research done to date points to the conclusion that there is progressive. 
differentiation of word m anings with increasing age and experience. 

Just one illustratiqn will be provided of the kind of evidence that 
supports this conclusion} Gentner (1975) completed a theoretical analysis 
of verbs of possession ich indicated that buy, sell, and spend entai | 
a more complex set of dijstinctions than give and take. Notice that giving 


v N 


involves, the transfer off something ,from one person to another. Selling 


likewise involves the transfer of something from one person to another 
but it involves an additional transaction as well, the transfer of money 


from the buyer to the seller. The complimentary relationship holds 


between buying and taking. 
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Gentner Yasceus children to acquire the full, adult meanings of 
these verbs in order of complexity. Children ranging from four to eight’ * 
years of age were asked to make dolls act out transactions fram directions 
involving each verb. Por example, the children were requested to ''make 
Ernie sali Bert a (toy) car.'! The foupoyeamotds performed flawlessly 
with directions containing give and take, but never correctly akecetad 
instructions that involved spend, buy, or sell. The eight-year-olds 
exhibited nearly perfect apaceenanatas of every direction except the ones 
containing sell. Overall, the results were exactly as expected: The 
adult meanings of verbs of possession are acquired in order of complexity. 

There is a substantial body ‘of literature on selected vocabulary of 
children from about two through eight years of age. The literature involving 
older children and adults igs meager. In our judgment, people's vocabulary 
knowledge continues to deepen throughout their lifetimes; that is, that 
as they grow older, most people continue to learn nuances and subtle 
distinctions conveyed by words that in some sense they have known since 


+4 


childhood. There is no hard data to support this conjecture. However, 


an illustration will show that many adults still have something to learn 
about even fairly common words. It is easy to find educated adults who 
“ confuse infer and imply. A person will say something along the lines, 


ny intended, by stating these arguments, to infer that . Of course, 


this individual should have said imply. Speakers imply: Listeners. infer. 
The complication, which no doubt makes the distinction difficult, is that 
: =; 


. 
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_ speakers may report inferences they have made as well as get implications | 


across to listeners. 


Breadth of Word Knowledge 


We have characterized breadth of knowledge as the number of words 
for which a person knows at least part of the meaning. It is disturbing 
to examine available estimates of the average vocabuJary size of yarious 
age groups. Table 2 summarizes studies that have been carried abt te 
estimate total basic or ''root'' word knowledge. It eave be seen that the 


estimates vary wildly. 


weer ew we em ee mem pe ee em ewer eee 


There sre tnoortant practical reasons for attempting to make accurate 
assessments of total word knowledge. Language and reading programs aim P 
to increase students' vocabularies. The number of words presented to 
students varies, in part, according to what is regarded as the most author- 
itative thinking and research on vocabulary size and growth (Clifford, 1978). 
More reliable estimates would indicate the appropriateness of the assump- 
tions of a program, and perhaps highlight periods of growth to be capital- 


ized upon. More generally, reliable estimates would indicate whether 


direct language instruction can plausibly account for a substantial pro- 
portion of the child's language growth, or whether word knowledge is-. 
acquired for the most part independently of formal instruction.’ To refer 


again to a concrete proposal, Becker's (1977) idea that underachieving 


Ig 
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children should be taught via direct instruction the vocabulary most high 
school eens possess would be difficult, but perhaps feasible, if the - 
children had to igara. 25 new words a week. It would be out of the question 
if they had to learn 25 words each school day. Or would it? e J 
Recently, the distinguished psychologist, George Miller (1978) 
stated: 
Although the rapid rate of syntactic acquisition has inspired | +. 
much eeepect fui discussion in recent years, the rate of lexical 
growth is no less impressive. The best figures available indicate 


; \ 
‘¢ that-children of avera intelligence learn new words at a rate 


of more than 20 per day., It seems necessary to assume therefore, 

that at any sap eieiiee time they have hundreds of words roughly 

categorized as to semantic or fonteat refevenee but not yet 

worked out as to precise meaning or use. (p. 1003) 

Miller did not specify whether or not he was referring to basic ‘ S 
words. If he was, then he is positing a mean annual word acquisition 
rate of over seven thousand words, or about fifty thousand over the 
elementary and middle school years. This seems unlikely even in the 


light of the highest estimates, summarized in Table 2. He may have been 


t 


4) 


including compounds and derivatives; however, to our knowledge, no 
4 


systematic examination of children's ability to understand these forms 
has been completed. We are puzzled to know what are the ''best figures 


available." 
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. In 1940, Seashore and Eckerson remarked that, even though the field 
of vocabulary testing is a ‘fairly old one'' (p. 35), substantial 


problems of measurement remained.~ By now, in the time span of educational 


A, 
research, we might want to call the Fi@ld "ancient," and virtually all of 
those original ‘problems persist. We wil}? present some of the central 
issues in broad-gauged measurement of word knowledge. The discussion 
\ 
\of these issues will be concerned largely with breadth of knowledge and 
wil reveal many of the reasons why estimates of vocabulary size have 
fluctuated so much. \ 
\ : & 
sefecting a Sample of Words ‘ we \ 
\ There are many thousands of words in English. Dupuy (1974), the °. “hy + 
aa of rer thorough study of word knowledge, ast) tes état theke : 


are ne a quarter of a million main entries in Webster's’ 
F oe 


(1961).\ Clearly we éannot test somebody on all the words in the dictionary, 
: \ ps 
so how can we select a group of words that will yield the most 


- 


information? Three questions need to be asked: First, what counts as a 


or not it is of interest to dis¢ern the student's ability 
\ | 


to use derivative§ and compounds (plurals, participles, tense markers, 


comparatives, ee Some authors, notably Seashore (1933), have preferred 


| 
{ 
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‘to calculate separate estimates for "'special'' terms and derivatives. 


Others, for example Dupuy (1974), have attempted to concentrate solely 

on ''basic'' words. Dupuy sampled randomly from Webster's Third New Inter- 
national Dictionary (1961) and then applied three criteria to each word 
selected: The word had te be a main entry, a single word form (i.e., not 
a derivative or compound) , and could not be pehAteal slang, foreign, or 
archaic. By this method, Dupuy estimated that English contains 12,300 
"'basic''.words. . 

The systematic nature of this sampling creates its own equally 
eiskenatle biases., Some children may have acquired the generative rule, 
for, say, negation by prefix, such as in aah and dishonest, and others 
may not have (Silvestri and Silvestri, 1977). Do we wish to exclude this 
element of vocabulary knowledge from the measure? Adults acquire a number 
of special or technical terms in their areas of expertise or interest, 
so exclusion of technical terms denies many people the opportunity of 
indicating their knowledge of a large number of words., 

1 


Many researchers opt for a random sample. Once a random sample of 


rds has been selected, a test is constructed to assess how many of the 
‘ : 


4 


wordssa person knows. Then, in principle, estimating the person's vocabu- 


lary size ts straightforward. For instance, Dupuy's Basic Word Vocabulary 


- 


Test contains I%.of the 12,300 basic words he calculated are in Webster's. 
Therefore, the absolute size of the basic word vocabulary can be approxi- 


mated bY multiplying the store on this test by 100. A person whose score 


is 60, after correction for guessing, would be judged to have a basic 


aN 


vocabulary of 6,000 words. a 
. aS, 
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One disadvantage of this method is self-evident. Estimated vocabu- 


lary size depends heavily on the size of the dictionary. With respect 


Pp 


to Pupine wine he sampled initially from a large unabridged dictionary, a 
a word had ‘0 appear . asa ayes entry in each of three Pe smaller 
dictionaries \in order to be counted as a basic word. A total of 979 

words, 41% of \the sample, were discarded on the basis ar thie rule. The 

result was a very conservative estimate of the number of basic words in 
American, English\ and is one reason Dupuy's estimates of basic vocabulary 


\ ; 
size are so much $malter than those of other investigators. Of course, 


many of these word$ were very rare, but others such as cloudlet, escaping, 


breezes, invited, starling, and unilateral would be familiar to most 


is the issue of what to do with derivative and 
compound -forms. A lib ral policy of selecting words will lead to large 
estimates of vasanlaiey size. A conservative policy wil] produce smaller 
sngieg Dupuy was conserv tive. He etininated 7.7% of the words in bis 


sample on the grounds that they were compounds or derivatives, including 


such as grandchild, package, and toothache. 


might not represent the language at large. 


_ a great many familiar ones 
So even such a random samp] 
A further problem is that projecting a vocabulary size From performance 

on a random sampling of.words \is inefficient. If the subject provides the 


, meaning of bibulous, then using \up test time by asking for the meaning of 
: et ROM: 


’ 


\bicycle is wasteful. When esti 


ting people's total vocabulary size is 


| 8g 
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the researcher's major aim, then efficiency of items covered per unit of 
examinee time is an important consideration. 

One obvjous response to these arab tenerys to sample words eit: 
éeount at frequency of usage. Terman and Merril] (1937) arranged their 
sample of words in order of difficulty. When the subject failed at six 
consecutive words, the vocabulary test was stopped. Dupuy (1974) recommends 
a similar procedure. Time can be saved by such a procedure, but vocabulary 
size ts likely to be underestimated, since most people would know a few 


rare fords. 


ff The characteristics of the two major, current word frequency compi|- 


dations available (Carroll, Davies, € Richman, 1971; Kucera & Francis, 1967) 
d a 


suggest a problem with frequency sampling. These analyses~indicate that 
the distribution of words is highly unbalanced, a conclusion reached eas 
25 years ago by for C1954) whe calculated that about 2,000 word types 
will account for about 95% of "'running words fa adate ence 3,000 

for 96.9%, 4,000 for. 94: 8%, and 10,000 for 99.4%. At the low frequency 
end of the scale, there is a tail that approaches infinity. Even in 

a huge corpus,a vast number of words appear only once, twice, or not at 
all. Of the 86,741 word types litsged by Carroll, Davies, and Richman 
(1971) from a corpus of over 5 million running words, 35,079 (40. 442%) 


ae gy! 


appeared once. Kucera and Francis (1967) found 44.72% of the words 


“appeared once in a sample of over one million words. . So, if the test 


is short, ‘the students run the risk of not being able to show that they 


eth 
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know several medium frequency words, since there\ will be such a large’ 


proportion of rare words in the sample. \A resolution of this issue is 


.important, since a frequency-based samo it ag been ue seems the most. 
accessible method for RS doRtHE the problems of simple random adie Hinge 
Frequency is a characteristic of a word which probably is very 
strongly related to the chances that the word will be known. One excep- 
tion to this may be the case of compound words. While, the root of the 
\ 
word may be very common and weld-known, a certain affix-root compound 
may be very infrequent, but almost equally well-known if the affix is 
familiar. So one analytic approach to the relationship between word 
frequency and knowledge would entail the use of family" frequency, that 
is, the frequency of the root word and all its compounds and derivatives. 
We might expect, then, that the relationship of this index of frequency 
of usage to the chances of the words being known would be more reliable. ~ 
Indeed, we are willing to go further and speculate that the relation- 
ship between family frequency and the chances of knowing a word resembles 
the\curve presented in Figure 1. In terms of breadth of knowledge, sii 
; She 


\ ae 

would expect a ceiling at the upper end of the frequency Scale: most 
\ . 

\ 

\ Insert Figure | about here 


people know all of the very common words. Other aspects of the curve 
would differéntiate individuals: The point at which the curve dropped 


from the plateau level, and the slope of the function probably are the 


. 
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two measures that would capture the important individual differences. Even 
for children, we might best think of the curve leveling out as the words 

6 
become very infrequent, since it is likely that, from their hobbies, 


idan aes or the occupation of their parents, most children: woukd know 


some very rare words. Nevertheless we have drawn‘the lower portion of 


a 


the curve ad a broken line since we are less sure about the relationship 


r 


in this area. 

-In summary, a good test of word knowledge would present the student 
with a large number of words, sampled liberally from the whole range of 
word frequency. Techniques should be developed which allow acturate 
estimation of the relationship of a given student's probability of knowing 


q 


a word and the frequency of the word's family. 


Determining That _a Word is in a Person's Vocabulary 


Four sorts of test formats have been employed’ in attempts to assess 


breadth of vocabulary knowledge: (a) multiple choice; | constructed 


4 


’ i r) 
answer, in which the student attempts to give a definition, a synonymn,- 


an illustration, or use of word in a sentence or phrase: (c) yes/no . 
judgments, in which the student checks the words in a list that he or she 
knows; and (d) matching, where the student pairs off words with their 
bocce, ‘ 

The question that needs examination- is which of these methods will 
be of most theoretical and practical value as a measure of vocabulary. 


We will discuss issues relating to three of these methods: multiple choice, 
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constructed ‘answers, and yes/no judgments. Since the points raised 


about the multiple choice format apply even more cogently to matching, 


 h 


the jatver whine be dealt with separately. 
Multiple choice methods. People of tan-aessexe partial knowledge of 

words. In these instances the i tens" dtstrantars become crucial. An 

individual may select the correct synonym for platitude from the choices: 

(a) duck-billed mammal, (b) praise, (c) commonplace remark, (d) flatness. 

He may make the correct se LGHGH beeuuse he has heard the word used in 

. reference to an utterance and with a negative connotation. This information, 

however, may nat enable Rim to select correctly-from (a) édanane lace remark, . 

: (b),, nonsense, ,(c) irrelevant question, (d) insult. The set of choices 

- constrains the Jndividuat's response konditferent degrees, and different. 

policies for generating distractors will, of course, lead to differences 

in performance. . ‘ 
Lepley (1955, 1965), for example; constructed two forms of a synonym 

test, one employing distractors from the same semantic category as the 

target ane another which used distractors ial semantically diverse 

categories. Lepley (1965)*: round equal reliability but significantly 

superior performance on the version requiring only Grose sizer iminatiens. 

Lepley' s nesulits Mites trate abs ‘Influence at Ste distractors. 


Py vee 


Thé mul eiplé sheies pahiat is curresitly thet most widely used in ‘ 


standardized vocabulary testing (e.9., Stanford Achievement Tests, 1973; 


Metropolitan Achievement Tests, 1970; California Achievement Tests, 1977). 
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The principal complaint raised h@re so far is that the distractors can- 
not avoid constraining the subject's response. . If the purpose of the 
test is to provide dats only on relative ner Fopuance at people, not on 
absolute level of performance, then the distractors can be; and usual ly 
are, chosen to maximize the discriminating power of the item. If one is 
“interested in vocabulary size, then this policy will not do. 

Many vocabulary tests (e.g., Stanford, 1973) use sentence completion 
in a multiple choice format. The problems already mentioned apply 
even when'the test simulates a real encounter with the target word. In 
add eter: the question of the effects of various amounts of contextual 
support on estimated vocabulary sve with groups of words that vary in 
frequency of usage has not been studied. There is research that suggests 


rf 


that individuals vary not only in“the size of their reading vocabularies 

but also in their ability to use context to deduce.the meanings of 
: unknown' and partly known words (Pearson & Studt, 1975; Mason, Knisely, 
& Kendall, 1978). | 

A erick problem with the multiple dykes format is that young 

children may noe consider all the distractors (Asher, 1978; Brown, 1975; 
Vurpillot, 1968). They will often choose the first or second alternative 
if tt makes reasonable enough pn The sapt=taking etratedies of older. 
children on multiple choice tests are not yet well characterized, but | 
there quite probably are strategic components of good performance which 


serve to increase spuriously the relationship between a multiple choice © 


Vocabulary test and other achievement or intelligence tests in the same 
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format. An insidious possibility is that. some of the apparent growth 
in vocabulary knowledge over the elementary dehaal’ veut Is really 
attributable to the acquisition of more sophisticated test-taking skills. 
In conclusion, the multiple choice format is the most popular one. 
It makes relatively efficient use of examinee time and must be reasonably 
valid, otherwise the strong relationships between sep Pucmanee on such 
tests and other measures of linguistic competence, summarized at the 
beginning of this paper, would not have been obtained. The chief compli- . 
cation with the multiple choice format, when one wants absolute measures 
of vocabulary knowledge, is how to choose distractors. A further problem 
is that multiple choice tests may make demands on strateote knowledge in 
which young and poor readers are deficient. 
“~chysteuctad answer measures. To overcome the problem of selecting o 

distractors, several researchers, notably Saaalssine (1933), Smith (1941), and 
Terman and Merrill (1937), have used a constructed answer format, in 
hich the subject reads or hears the target word and then Geta or tells 

definition of it, uses it in a sentence, gives a synonym for it, or in. . 
some other way provides an indication of its sense and reference. 
Subjects can be encouraged to do any one of these things just so long 
as the experimenter is convinced che word is “known! This format is. netomat 
capable of dealing with.za variety of levels of knowing a word and avoids 
the issue of distractors. There are, however, two substantial problems 


with constructed answer measures: the problem of scoring the answers 


and the problem of what is really being measured. 
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In the ‘written format, in particular, a constructed answer weenute 

is confounded by factors Such as spelling ability, sentence construction 
ability, and even the ability to write legibly, all of which may discourage 
a subject from elaborating on a word used or understood in conversation. 
A slightly more subtle problem, and one that is sara: abetted: to control, 
resides tin the fact that, if a liberal criterion is used and the subject 
is allowed a range of seesi his responses to a target word, then a par- ~ 
ticular strategy for responding may be adopted. The Erondet is that some 
words would be more easily explicated in a saretediar fort: The word 
noun may be more easily explained through illustration than by definition, 
for instance. The research of Anglin (1970) and Wolman and Baker (1968) 
indicates that, up to the age of about 10-12 years, chi Idren tend to 
provide concrete definitions-by-illustration rather than by an inclusive 

| term or synonym. It is entirely pencils that, depending on scoréng. 
criteria, the preference ata different age for on explanatory 

got Cane could produce Spur IOUS estimates of the rate of vocabulary 
growth. 

A really eee problem is how liberally to score answers. How 

does one score synonyms in relation to apt illustrations or perfect 
usage in a-sentence?-In-many~instances, partial~knowledge"ts~displayed:~ = sie aca 
In one of our own recent testing sessions, it became clear that many fifth 
grade students had partial knowledge of the word forbid. - Several piiidente ‘ 


knew that it had something to do with not being permitted to do something 


but did not have as part of their knowledge the fact that forbid is used . 


TT 
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in imperative speech acts. We soon realized that, in this case, we 
needed to ask for its use in a sentence. We have found other more subtle 
and difficutt cases of partial knowledge. . For che word propelled, there 
was no problem th the students' recognition of the word because of their 
knowledge of propeller. When probed about the function of a Bre late 
many came close to generating the notion ‘of propulsion on the theory 
that it would be strange to have a as round blade going around on the ™ 
Fendt of a plane unless it served some. fairly fundamental purpose~~and 
what isnes do is move. ; 

Some words have no near synonyms. Thbige. avaodior instances when 

SS } 

the only synonym is a less frequent word than the target. In ‘such cases, 
the subject is being asked to produce a rare word in order te show: that 
a common word is known. | t 

There are some almost irresistible tendencies displayed by an — i 
examiner when administering a test with a constructed answer format. 
After a few children have been tested, the examiner develops a caries of — 
which words are easy and which are difficult. It requires conscious 
effort to avoid expecting more explanation of the difficult’ words snd” 
less for the easy words. If every sabrwee tae known chair and the current 
subject pats the seat-of-his’stool-as~a NeEPONSE therr” the “tendency” 15° 
to award. full marks. If he pats the wall “for edifice, however, he might 
not score so well. Similarly.there is an urge to expect more elaborated. - 
responses from Hier subjects. The preschooler who tells you that an 


automobile ''goes brreeremmm"! will strike you more favorably than the — 


. 
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college sophomore who gives you the same answer. In addition, the 


verbal as well as verbal cues. Young children typically employ hand 


movements, facial expressions, and gestures in their- communications 


The herng of the dilemma are these: Skringent, operational, adult- 
like standards for evaluating whether a response indreates a word is 
known will confound what is supposed to be a measure of breadth of 
vocabulary knowledge with expository ability. Looser, more flexible 
standards will confound the measure with the subjective judgment of the 
examiners, which may change from word to word, subject to subject, and 


occasion to occasion. 


be Rd 
= Se 


cal and substantial. It is inefficient per unit of testing and scoring 


examiner, especially when the person displays partial knowledge of an 
rien, | 

Yes/no format. The final format to be epetdered is the jes 
method. In this format, the serene simply indicates whether or not the 
heaatae of Siew is known. Two of the: Hajar di ffleuittes that have 


arisen consistently in the discussion of the other two major formats 


a large number of words chosen froma wide frequency range. 


32. 


experimenter will witness explanations of words which entail] subtle non- 


especially when dealing with words that are a ljttle difficult for them. 


So the liabilities of the constructed answer method are both logisti- 


time, and it seems to rely on often subtle intuitions on the part of the 


* 7 
are the problem of what the test really measures and the need to present 


* 


Vocabulary Knowledge 


3] 


The checking format can edtlety the second criterion admirably, but 
problems of validity arise. Sims (1929) concluded: 
The writer is inclined to belieye that a good guess as to whether 
or not a child knows the meaning of a word jis almost as satis- | 
factory a method of determining vocabulary as checking tests. 
The relative simplicity of such a’measure, the ease of prepara- 
‘ten and administrat ten should not biind ee to its invalidity. 
ee a 
Chall and Dale (1950) raparted that the average tendency to overestimate 
word Knowledge in the yes/no format over and above the definition format 
amounted to about 11%, and was more pronounced for rare words. 


It ought to be no real surprise that a yes/no test uncorrected for 


" guessing and risk-taking would give inflated estimates of vocabulary size 


and would correlate poorly with other measures. - Consider the: yes/no task 
from the point of view of the test taker. Some individuals may deny that 


they know the word gold because they do not know its atomic weight, while 


® 


others will agree they know it because they have a feeling that it can 
be used to refer to a color. How do we take account of differences in 
me 


are willing 


as 


the degree of confidence individuals must have before they 


to say, ''Yes, 1 know that word!'? 
One method is to mix in some nonsense words, which allows one to ¥ 
determine how often the student is guessing. " The student who says "'yes'! 


to a lot of the nonsense words is acting without much reliable. information. 


‘We are currently analyzing data collected from elementary and high school 
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subjects on large numbers of words. The students responded yes or no 

to a mixture of many Engr ishewarale and almost as many joneenae words. 

Later they completed standardized multiple choice questions on the real 
words. Our preliminary analyses have indicated that yes/no scores adjusted 
for guessing and risk-taking correlate highly with multiple chotes per- 
formance. We later interviewed the subjects individually about a subset | 
of the words.; The data suggest that a value derived from the yes/no 

task gives a ene estimate of true word knowledge than performance on 

the standardized multiple choice test. 

“The fact that words have multiple meanings poses a problem for the 

yes/no task, since presumably a person wil check Mes VE he “OF ‘she “knows 
any meaning Or: a word. This is not a ‘small problem: According to Lovell] 4 

(1941), 43% ae the words used by Seashore and echersan (1940) had multiple \ y 
meanings, Recently, Balch (cited in Johnson & Pearson, 1978, p. 17) has 
"reported. that from 23% to 42% of the words in six widely used basic vocab- 
‘fey tists have multiple meanings. In other recent research, Mason, 
Knisely, and Kendall (1978) have shown that children are much less 

likely to know the secondary than the primary meaning of words used in 

their secondary sense in a popular basal series. It is apparent that he 
yes/no format is not suitable for distinguishing which of the meanings of 
‘a word are known. When that is the goal, some other method of assessment - 

is required. 


In summary, the great attraction of the yes/no'format is that it . 


permits the presentation of a very large number of words ina given : . ’ 
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interval of examinee time. Compared to the multiple: choice| format, it 


\ 
reduces somewhat the burden of Praperlig distractors and, compared to 


¢ 


* va 2 
constructed answer formats, it ee vagaries of scoring. The, not~ 
able problem with the yes/no task is \that scores of individuals will be> 
influenced markedly by differences in tendency to take risks in the face 

“sear t 


\ 
of uncertainty. If this problem can Perens the yes/no task might be 


very useful for assessment of pesudeh ah wave knowledge. "A 3 \ e 
er rerrae \ \ 


\ 
va 


: Conclusion 3 oe 
While currant research demonstrates \. importance of such factors ¢ 
as a reader's perspective on a text (Pidhert & Anderson, 1977) and test 
structure (Meyer, 1975; Mandler & Johnson, 197), it is also clear that 
word knowledge is.a requisite for reading “comprehension: People who do 
not know the meanings of very many words ane most probably poor readers. 
There are serious gaps in our understanding \of why this is. true and of 
how Word knowledge grows throughout the falas Filling those gaps 


\ \ 
promises to be both an intellectual and a ee challenge of ‘con- 


siderable importance. | We judge that a critical first step is the devel- 


so ont nro 


opment of improved methods of assessing dencil 


It is only after some ref Tnement hae-bean achieved at\ this level. that 


\ 
models of lexical development and instructional on 


s can be based 
on realistic expectations about the acquisition o | wor ‘meanings. o> 
We conclude our review of ‘vocabulary knowledge and\vocabulary size 


with the real ization that, since the turn at the century a tremendous 


\ 
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amount of energy has been put into answering the question) ''How many 

words does an individual know?!’ We have come to wonder if\this question ¢ 
is ees framed. The nature of language may make it unanswerable and 
thus, for scientific purposes, irrelevant. Empirical method "may be 

able to generate useful indices such as that discussed earlier--the 
relationship of the individual's knowledge of words to word Frequency. 

1 produce a single value from performance on a sample to evry att total 
vocabulary size, however , may be an exercise that relies too heavily on’ * 


the assumption of a static population of words and on an overly restrictive 


view of how we generate and use them. ‘ \ 


*\ 
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Table 1 


Correlations of Various Vocabulary Tests With Tests of General Intelligence. . 4% # 


t 


_ Vocabulary : Intel ligence es. € el i 
“Measure Measure Subjects -N ft: _, Source 
Terman, 1916 Binet (1916) Schoo] children 631» 91 . Terman (1918) 
Binet (1916) School children 269 «~«. «.87, Mahan & Witmer (1936) 
Binet (1916) | School children . 65  .92  — Spache (1943) 
Binet (1916) -° School children © 1161 .98 Elwood (1939) 
Terman, 1937 Bipet (1916) . School children ~ 7952 86. “White (1942) 
Terman, 1937 Binet (1916) Standardization 710 7 - 
sample, ages to f- 
8-18 86 McNemar (1942) 
Wechsler Wechsler Ault males 1000 .82 Lewinski (1948) 
Wechsler WISC : Standardization 600 7 
’ sample. ages .87 ; 
7.5; 10.5,.13.5 78 Wechsler (1949) 
Raven Binet School children 150 93 Raven (1948) 
Dupuy Various tests | School children \ 2397 76 . Dupuy (1974) 
Stanford . | : : ae 
Achievement Standardization Stanford Achievement 
Tests (1973) samples Test (1973). 
Grade 2 . £82, 
(vocabulary 3 79 
with total 4 275,000 .80 
achievement 5 over 80 S 
test scores) 6 grades © 83 Tate, 
8 and geog. ~~ 
locale 89 Tig 


Note. Adapted from Miner, (1957). Se 
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\ . Table 2’ a 
Some Previous Estimates of Total Vocabulary Size 


at Selected Grades 


Grade Source ‘Estimate. om 
| Ist Me Ea Smith (1926) ~~. - - 2,562 : 
tee 20° : Dolch (1936). - eg 
? Ames (1964) : 12,400 °°" %. : 

M. K. Smith (1941): ) 17,000 
Shibles (1959) 26,000 
. 3rd, ~ Dupuy (1974). ye: 2,000 
Holley (1919)- : 3,144 
Terman (1916) . 3,600 
Brandenburg (1918) 5,429 
Kirkpatrick (1907) 6,620 
Cuff (1930) : 7,425 
M. K. Smith (1941) 25,000 
7th Dupuy (1974) | 4,760 | 
* Terman (1916) 7,200 
; Hol ley (1919) bes 8,478 
Kirkpatrick (1907) ° 10,666 
Brandenburg (1918) 11,445 
Cuff (41930) - 14,910 
Bonser, et al. (1915) 26,520 
M. K. Smith (1941) 51,000 
College Seashore (1933) -15,000 
sophomore Kirkpatrick (1907) 19,000 
‘ Seashore & Eckerson (1940) 60,000 
| Gerlach (1917) 85,300. 
Gillette (1927) * 127,800 
Hartman (1946) 200,000 
ee Note. Adapted from Seashc. + and Eckerson, 1940, and Bayer yf 
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Figure 1. Possible relationship between likelihood word meanings iy 
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